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ABSTRACT 

A digital image capturing device which communicates 
through an input/output interface with an external process- 
ing device which monitors and/or controls the camera. The 
image capturing device communicates with the external 
device in order to output status information to the external 
device, receive commands from the external device and to 
transfer images and sound between the image capturing 
device and the external device. Various parameters describ- 
ing the state of the image capturing device are transmitted to 
the external device including characteristics of the captured 
images, whether the flash is ready, the state of the device 
battery, w hether th e_jnemorvJs full, or the parameters used 
when capturing images. The commands which can be sent 
from the external device to the image capturing device 
include commands to change any of the parameters of the 
image capturing device and a command to capture an image 
or a series of images, and whether or not sound is recorded. 

19 Claims, 12 Drawing Sheets 
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DIGITAL IMAGE CAPTURING DEVICE as the same becomes better understood by reference to the 

HAVING AN INPUT/OUTPUT INTERFACE following detailed description when considered in connec- 

THROUGH WHICH THE DEVICE IS tion with the accompanying drawings, wherein: 

CONTROLLED FIG. 1 illustrates a digital electronic camera constructed 

raoss UFFFRFNPFS TO pff ATFn 5 " acoordancc with the invention connected to an image and 

CROSS-REFERENC^ TO RELATED audk) device? and haviQg a memQry card and ^ 

AtTLlCAllUN QUtput card conned thereto; 

This application is a continuation of Ser. No. 08/535,562 FIG. 2 illustrates the I/O card and the memory card being 

filed Sep. 28, 1995 now U.S. Pat. No. 6,104,430. connected to the camera; 

This application is related to commonly owned U.S. 10 FIG. 3 illustrates the camera connected to various types of 

patent application Ser. No. 08/535,378, now U.S. Pat. No. monitoring, printing and processing devices including a 

5,754,227 concurrently filed with the present application and television, telephone, computers, and printers; 

entitled "Digital Electronic Camera Having an External FIG. 4 illustrates a camera constructed in accordance with 

Input/Output Interface Through Which the Camera is Moni- M the invention connected to a computer which is in the same 

tored and Controlled," which is incorporated herein by building as the camera; 

reference • 

FIG. 5 illustrates the camera connected to a computer 

BACKGROUND OF THE INVENTION which is located in a building which is different from the 

building containing the camera; 

1. Field of the Invention 20 piG. 6 is a block diagram illustrating the construction of 
The present invention relates to a digital electronic cam- the camera; 

era or device and the interfacing of the camera or device to mG ? / a Wock di umstrating ^ details of the 

an external processing device which monitors and/or con- ™ 1T r ,« * 

, , ' . . ., , , _ v_^x u or me camera, 

trols the camera or device through an input/output interface. ^„ „ .„ t 4 . L wt ^ a „ t 

. ^ . . n . t , nK FIG. 8 illustrates details of the I/O card of the camera; 

2. Descnphon of the Related Art 25 ^ ^ ^ 

Digital electronic cameras are becoming more popular as FIG. 10 is a flowchart illustrating the processing per- 

thc size and cost of electronic components continues to go formed when Qf ^ afe ^ 

down. However, a disadvantage of digital electronic cam- camera* 

eras is that they typically do not possess the ability them- __ * . . . „, , 

selves to provide a permanent hard copy of an image or 30 . FIG * X \ 15 a timin e dia £ ram ^ustrating the coding of 

picture which was taken. Ima 8 e and audi0 sl S nals ' 

Japanese Laid-Open Patent Publication 4-980(1992) dis- ™; 12 is a timing diagram illustrating the decoding of 

closes an interface card usable with an electronic camera coded una S e and audl ° *&^> 

which is capable of transmitting data out of an electronic 35 FIGS. 13A-13C illustrate different manners of construct - 

camera. However, this interface is quite limited in the ing the coded image data; 

functions which it can perform. The present inventor has FIGS. 14A and 14B illustrate the manner of coding audio 

recognized a desire to be able to have more flexible and signals; 

efficient electronic communication with electronic cameras. FIG. 15 is a flowchart illustrating the process of changing 

SUMMARY OF THE INVENTION 40 P arameters ^ to C0Dtro1 ^ camera i and 

FIG. 16 is a block diagram illustrating a circuit for 

The present invention includes a system and method for creating evaluation values, 
digital image capturing and/or communicating. The digital 

image capturing system includes a digital image capturing DESCRIPTION OF THE PREFERRED 

device. This device includes a lens, an electronic image 45 EMBODIMENTS 

pick-up, a processor, a communication interface, and a Referring now to the drawings, wherein like reference 

detachably connected input/output interface. This interface numerals designate identical or corresponding parts 

includes a connector which connects to the communication throughout the several views, and more particularly to FIG. 

interface of the digital image capturing device, and a con- X thereof, there is illustrated a digital electronic camera 30 

nector which connects to a processing device which is 50 constructed in accordance with the teachings of the present 

external to the digital image capturing device. The commu- invention. This digital electronic camera is designed to 

mcation interface of the digital image capturing device ca pture still imae^ uUc^n>aJso^apture a series of still 

receives commands for controlling and operation of the images m order to create moving pictures in a similar 

digital image capturing device from the processing device. manner as a cam-corder or video camera captures moving 

In the method for communicating, there are performed ss images. The camera 30 includes a lens 7, a microphone 1 for 

steps including the steps of transmitting control commands obtaining audio, and a flash 20 for illuminating an object to 

from the processing device, receiving the control commands be photographed. The camera 30 includes a card connector 

by a detachable communication interface, and changing a 17 for receiving two PCMCIA type cards such as a memor y 

state of the digital image capturing device using the received card 16 ancTan input/output (I/O) card 15 which has a 

control commands. Additionally, there are performed a 60 communication line 24 connected thereto. The I/O card 15 

determining of a state of the digital image capturing device, allows images, audio, and control information to be trans- 

a transmitting of parameters, and a loading of a control mitted into and out of the camera 30. Connected to the 

program. camera 30 is an audiovisual monitoring device including a 



color LCD panel 31 and an audio speaker 32. Images 
65 captured through the lens 7 and from images stored in the 
A more complete appreciation of the invention and many memory card 16 along with audio can be displayed and 



BRIEF DESCRIPTION OF THE DRAWINGS 

more complete appreciation of the invention and 
of the attendant advantages thereof will be readily obtained played on the LCD panel 31 and speaker 32, respectively. 
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Additionally, various commands and status information captured by the camera or a digital copier 36 which also 

along with any other information such as the status of I/O prints full-color photographs of the captured images, 

functions can be displayed on the LCD panel 31. The LCD A feature of t he invention is that the. Higifa ] e,]e rt™^i r 

panel 31 including the speaker 32 is not required to operate can&ta can leulolelvt ransmit anoLr eceiyeJm^es^EQmra 

the camera and are easily detachable from the camera in 5 conUeUed UJhlpUtei aii iTalso be momtor MiiLcojilrQlled by 

order to reduce the size and weight of the camera, if desired. tB e-eeMBpirteT rFTGr^Tllustrates the camera 30 which is in a 

FIG. 2 illustrates the details of how the cards 15 and 16 first room connected to the computer 33 which is a different 

are connected to the camera 30. The camera 30 includes a room of the same building. In this manner, images o f the 

first card connector 17a and a second card connector 176, digit al electronic camera 30 can be monitored and stored in 

both connected to a card interface bus 25. The cards 15 and 10 the compuieri3 j anaUbe>cx >mputer 33 can b e used to control 

16 can be connected to either of the card connectors but are and monitor tne settings o f "the can Wa^30*^K c= aT g tRe 

illustrated as 1/0 card 15 being connected to the first card brightness^bTlurninance' of TfilT image"," the amount of image 

connector 17c and the memory card 16 being connected to compression performed by the camera 30, the white balance 

the second card connector 17 b. The memory card 16 can be of the camera 30, or other operating parameters, 

any type of memory device which plugs into the camera. 15 FIG. 5 illustrates that the_ camera 30 and monitoring 

However, the preferred embodiment of the memory card is co mputer i3 can „ h&, n locaie 4 in different buildings and 



PCMCIA 2.1/JEIDA 4.2 standard and which can plug into other-mannunsf communication such as/tiy_ wjuslejss. 
personal computers in order to easily transfer images and ^-^munication .Tpe* remote connection of the camera lib to the 



a PCMCIA flash memory card which conforms to the connected by wires such as through a telephone-network 0P\ 

other-manner^ communication such as{By^wjr^j5ss-co > aa^; 

. > ^muni < ^ ... 

sound to a computer. Additionally, the control program for ^rj-xtffiipu^er 1 ^ can be quite useful for monitoring purposes 

the I/O card may be transferred either from the memory card such as for security or safety reasons. By connecting the 

16 or preferably, from the I/O card 15 to a memory within camera to a Local Area Network (LAN), a plurality of 

the camera 30. As an alternative to having the communica- cameras may be connected to a single communication line, 

tion line 24 connected to the card 15, the line 24 may be Akn tly t camera nf the present invention can be easily used 

connected to other parts of the camera through appropriate 25 fr^ monitor ab a b r£br other object by an adult who is at home, 

terminals. e^sfc^Hrtault is working on a computer due to the 

The camera of the present invention is quite flexible in increasing popularity of the displaying of a plurality of 

1 thatit^ can he connected t ^ many diflfcrpnt types "f p^rifWfll windows on a computer. Further, through the use of 

|dejices^Asillustrated in FIG. 3, the camera is connectable modems, a telephone call from the computer 33 to the 

the LCD panel 31 and speaker 32. Alternatively, audio/ 30 camera 30 can allow for an expensive manner of performing 

video outputs from the camera 30 may be connected to a a remote monitoring function. Additionally, a conventional 

television 37 which is connected to a photograph printer 31. camera moving system can be employed which allows the 

Further, the I/O card 15 may be connected^ throng h-t^ T ^_* camera position to be remotely controlled by the computer 

2TTo a telephone 32 which is either_a ce l lulaZ otJareless 33 or other controlling device. 

rjToine^or aphone connected to a conventional public service 35 FIG 6 is a block diagram showing the details of the 
telephone network (PSTN), a PBX telephone system or an cons iructio n of | the camera 30. The microphone 1 is con- 
ISDN. In order to connect the camera 30 the telephone 32, necteWD^n^n^SnTrOTleTTSTwhich outputs a signal to an 
the I/O card 15 or the camera itself must function as a analog-to-digital converter 4. The amplifier/filter 2a reduces 
modem. Ima ges capmre,d J^tlie_can iera can be transfe rred the audio signal to the appropriate bandwidth. The analog- 
through theT7G[~ca^^ 40 to-digital converter 4 operates with an optimum sampling 
cojlHe6ted to an on-line servic e. Such.as ^A meacaJDn ^Line. frequency, for instance, at a frequency which is an integer- 
This*tnexpehsively allows images to be taken by a person at times of the sub-carrier frequency of an NTSC signal used 
a first location to be transferred to a file storage device and by the camera. Further, a sampling frequency of the A/D 4 
subsequently viewed by another person at a second location is more than two times the necessary bandwidth. An audio 
who has access to the image/voice files. As an alternative to 45 data compression/expansion circuit 3 is used to encode and 
aving the I/O card 15 function as a modem, the I/O card 15 decode audio signals using known methods of audio encod- 
may function as an RS-232 interface which is connected to ing such as linear PCM, Dolby AC-3, or MPEG-2 audio 
a separate modem. encoding. The compressed audio signals are transmitted to a 
In FIG. 3, the camera 30 is also illustrated as being FIFO circuit 13 which functions as a memory and alterna- 
connected to a desk-top computer 33 or a lap- top portable 50 tively can be a DRAM. The FIFO circuit 13 includes a 
computer 34. In this case, the I/O card 15 will function as a section for images and a section for audio. Unencoded 
serial communication connector card such as an RS-232 digital audio signals from the compression/expansion circuit 
communication interface. Additionally, the memory card 16 3 are transmitted to a digital-to- analog converter 5 and 
may be inserted into either of the computers 33 or 34. subsequently amplified and filtered by the amplifier/filter 2b. 
Typically, the portable computer 34 will have built therein a 55 The audio signals included in the signals 26 are then output 
PCMCIA connector to receive the memory card 16 contain- to a suitable audio generator such as the speaker 32 or a 
ing images and possibly sound which are recorded by the speaker of a television. 

camera 30. A PCMCIA card reader or peripheral connector An image photographing section 6 of the camera includes 

will have to be used in conjunction with the desk-top a photographing lens 7, a lens opening 8, an image photo - 

computer 33 to read the information from the memory card 60 graphing element 9 such as a CCD (charge coupled device) 

16. The computers 33 and 34 can display the^pCDoted or a MOS-type image photographing element. The CCD 9 in 

images and sound, may bemus ed to jnaninulate^he imaM s the preferred embodiment has a resolution of 768x480 

and sound, and may be used to monitor apff contro l tfe (horizontalxvertical). The output of the CCD 9 is transmitted 

c amera. T he computers 33 and 34 caif be^Jg^rffc to a circuit 10 which eliminates noise from the analog signal 

compatibles, Apple Macintosh compatibles/^Drtny other 65 output by the CCD 9. This may be accomplished by a 

type of computer. The computers are connected to a color correlative doubled sampler (CDS). The output image signal 

printer 35 which prints color photographs of the images from the image photographing portion 6 is transferred to an 
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analog-to-digital converter 4 which transmits a digital image matic focus controlling information, and automatic white 

signal to a digital signal processing circuit 11 which, for balance evaluation information by the CPU 23. Automatic 

example, performs ordinary and known treatment of the control of the camera is performed using this information, 

image signal including gamma-compensation, color Additionally, this and all other evaluation data, control data, 

separation, and generates the luminance signal Y, and color 5 status data, etc., can be output through or stored in the I/O 

difference signals Cb and Cr in a known manner. An card 15 or stored in the memory card 16. This information 

example of the performance of these functions is disclosed may be used, for example, when monitoring the camera in 

in U.S. Pat. No. 5,343,243, which is incorporated herein by order to determine if an abnormal state exists. Further, the 

reference. Video signals (either analog or digital) are output quality of the image can be optimized by changing the 

from the digital signal processing circuit 11 as a video signal number of pixels used to represent an image. 
26 which is display by the color LCD panel 31. Thc cpu 23 ^ performs a clock function for recording 

An image data compression/expansion circuit 12 can be the date and time of when the audio and video has been 

used to encode and decode the images using known image captured. Additionally, a field number may be added to the 

compression methods which transform the images ; into ^and ^ data b lhe cpu 23 £ach of ^ ^ datflj audk) 

out of compressed formats such as GIFF, JPEG, MPEG or d d ^ ^ fidd numbef be ^ fa ^ 

any other known image compression method. Details of card interface circuit 14 to either the memory card 16 or I/O 
image compression which may be used by the camera 3U are , 1 - 

disclosed in U.S. Pat. No. 5,414,464 which is incorporated ca * * „ , .„ , . M ^ m , „ r „ m 

herein by reference. Acard interface circuit 14 is connected Details of CPU 23 are luustrated m mG J' ln , } ' ' 

to the card connector 17 through the card interface bus 25. me cpu 23 contains a microprocessor 50, RAM 52 for 

The card interface circmUW cuuk^H*Ummsmie*tianfi20 storing various information and serves as a working memory 

bet ween the camera andrthe phifl-in communication cards^ area as calculations are being performed, and a control 

which for example may fun cTluu ao a -Ia AN - caii lr a 1 mo dem program storing area 51. The control program storing area 

card either for a conventional wired telephone system or a 51 includes a section 55 for storing basic routines such as 

ce llular phone , a Small Computer System Interface (SCSlS BIOS (Basic Input Output System) routines, and other 

interface, or an ISDN interface Jo r any othe r type of fovipfiN^ routines used by the system. The basic routines 55 are stored 

From interface circuit 14, imaged and audio are output \ar in a nonvolatile memory such as a flash memory, an 

memory card 16 or I/O card 15. Also, may also be trans- EPROM, or other type of memory. There is a section of the 

ferred to interface circuit 14 fromfiatds-iS or 16. control program storing area 51 which stores rewritable and 

A Central Processin g Unit 2^(CPVQ^mtrols the opera- optional routines which may be loaded in from the memory 

tion the camel J and is UMfleWeu'lU a fflBue display 22 which 30 C ard 16 and the I/O card 15. Section 54 may be constructed 

displays various operating parameters of the camera includ- us i ng the same flash memory as stores the basic routines 55 

ing modes which have been set and operating parameters of or mav De a separate memory. In order to reduce the size of 

the camera. The mode display 22 may be an LCD or IJED the chip and reduce the cost of the ship which may be used 

display. An o perating portion 21 through . whichUhe^ user as m e CPU 23, it is desirable to use a flash memory to store 

inputs commaruis sucn as Ihe^co^ arDana^g J^ajke a picture 3 S the basic routines 55 and the rewritable and optional routines 

when lhe shutte r button is | pre ssed, whetner sound is 54 The CPU 23 may either be a single chip or be composed 

recoraea', wSeTher still images or a series of still images 0 f multiple components. By having a section for rewritable 

forming moving images are recorded, and all other opera- m & optional routines, the camera becomes very flexible by 

tions of the cameras. A flash 20 which is powered by allowing the camera to be programmed as desired and there 
batteries (not illustrated) is connected to the CPU 23 and 

40 is no need to store routines which are not going to be used, 

used to illuminate the scene to be photographed. There is a This rewritable and optional routines section is especially 

driver 18 which drives a mechanical system of the image uscm i f or mc process of inputting and outputting informa- 

photographing portion 6 and performs functions such as tion as there are many different communication protocols 

focusing and zooming of the lens. The timing signal gen- which may be used. The control program storing area 51 

erator 19 generates various timing signals as images are 45 stores routines which control the fundamental functions of 

captured such as a vertical synchronizing signal, a horizontal the camera and other functions such as reading out program 

synchronizing signal, and a CCD synchronizing signal. data, changing parameters within the camera, writing data 

Compressed images which are stored in the memory card into the rewritable and optional routines section 54, and any 

16 may be read out of the memory card 16 through the card other function of the camera. Supplemental circuitry 53 

interface circuit 14 and stored in the FIFO circuit 13. The 50 performs functions which are necessary for the CPU and 

compressed images are subsequently transferred to the includes a bus controller, a serial communication controller, 

image data compression/expansion circuit 12 which decodes an interrupt controller and analog-to-digital converter for 

or expands the compressed image signals and transfers the monitoring analog signals, and a clock for keeping track of 

signals to the digital signal processing circuit U. In the the time and date. 

digital signal processing circuit, the luminance and color 55 FIG. 8 is a block diagram showing the construction of the 

difference signals are transformed to a NTSC signal and \/q card 15. The I/O card, if desired, can include the 

output as a video signal. functions of the memory card 16 if it is provided with a 

Compressed audio information is similarly read out of the sufficient amount of memory. The I/O card 15 includes a 

card 16 and written into the FIFO circuit 13. The encoded card connector 40 which plugs into the card connector 17 of 

audio signals are transferred to the audio data compression/ <>o the camera. There is an attribute memory 41 for storing 

expansion circuit 3 where they are converted to an uncom- attributes of the I/O card such as whether the I/O card is d 

pressed digital form, converted to an analog form by the LAN card, a SCSI card, a serial card, a parallel card, an 

digital-to-analog converter 5, and amplified and filtered by ISDN card, a modem card, includes memory to store images 

the amplifier filler 2b. The converted signal is output as thc and sound, etc. There is a card interface 42 which interfaces 

audio signal. 65 communications between the camera and the 1/0 card 15 and 

The digital images captured by the camera are used to also contains sufficient memory to store some picture and 

create exposure controlling evaluation information, auto- audio data. The exact size of the memory within the card 
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interface 42 depends on the requirements of a user. An I/O as a SRAM card, a ROM card, etc., the appropriate control 

prolucul contloTC! 4j serves as the main processor of the I/O program transferring may also be performed, 

card 15 and controls the functions performed within the I/O FIG. 11 is a timing diagram illustrating the operation of 

card. The I/O protocol controller 43 controls communication encoding or compressing image and audio data and the 

to ensure conformance with the appropriate type of com- s process of transmitting this data in real time. In FIG. 11, 

munication protocol, which corresponds to the information when the image compression or encoding begins, a start 

stored in the attribute memory 41. A flash memory 45 command is received from the side of the memory card 16, 

contains the I/O card controlling program which is loaded the image data compressed in real time in the JPEG (Joint 

into the rewritable and optional routines section 54 of the Photographic Expert Group) format is written in the FIFO 

control program storing area 51 illustrated in FIG. 7. This circuit 13. All of the real time image transmitting periods are 

control program is transferred to the rewritable and optional the same. Next, the CPU 23 controlling the system sends out 

routine section 54 after the I/O card 15 is inserted into the ^ status information and table information used for encod- 

camera. The communications which enter and leave the mg and decoding at the camera side to the I/O side during 

camera through the line 24 pass through an I/O connector 44 the yertical blanking period . ^ irnage data recorded in the 

which may _be .any type of connector which is suitable to ^ FIR) ckai[{ n {q ^ Qext ficld are ttUjmiVLed ^ ^ gh 

connect wi e ine . speed to the memory card 16 functioning as a recording 

FIG. 9 is a block diagram showing an example of the medi(Jm b direct me acc6SS (DMA) UaDsktdQg 

orgamzation ot nies witmn me memory card 16. as me ^ ^ 

is issued from the memory card 16 

memory card 16 will be readable by a personal computer *, t . 7 . , . . . , J . . 

such Z an IBM compatible or Macintosh compatible dunn S ^ v f al bl f ?™<f, the camera control 

computer, the files will be stored according to the cor re- 20 commands and parameters are read out from the memory 

sponding file format such as a DOS format used with IBM card or 1/0 card t0 ^ camera - 

PC compatible computers. The memory card 16 contains When the image coding system is a variable length coding 
three images files 60a-60c, two audio file 61a and 61b, and system such as JPEG, it is necessary to perform the opera- 
two input/output control files 62a and 62b. As an alternative tion of controlling so as to prevent the FIFO circuit 13 from 
to storing the illustrated files in the memory card 16, these 2 5 overflowing during the vertical blanking period. In such a 
files may also be stored in the I/O card 15. The I/O control manner, the coded image data is transmitted to the memory 
files are used to indicate the type of files and other infor- or I/O card in real time and the status signal at the camera 
mation regarding how the files are arranged and how to read is sent out and the camera controlling command sent from 
the files. In order for the camera to read and utilize new file the memory card 16 is read out and the internal control is 
formats, the I/O control files may be transferred to the 30 practiced. The above operation continues until the digital 
rewritable and optional routine section 54 of the CPU. These camera receives the real time data stopping command from 
I/O control files may also store conventional DOS or Macin- the memory card. 

tosh file format information. As the camera can receive I/O With regard to compression of the audio information, the 

control files, it does not have to be pre-programmed with audio compression occurs at the same time as the image 

every different type of control file which can reduce the 35 compression is occurring. The compressed audio data is 

expense of the camera and the amount of memory needed in written byte by byte in the audio FIFO of the FIFO circuit 

the camera. 13 every 250 microseconds. When the fullness of the FIFO 

When a card is inserted into the camera, the camera may reaches a predetermined amount, the CPU 23 instructs the 

prompt the operator to select the appropriate I/O or memory card interface circuit 14 to perform DMA transfer to the 

functions. Additionally, the control program in the card is 40 memory card 16. Usually, checking of the remaining capac- 

transferred to the rewritable and optional routines section 54 ity of the audio FIFO is practiced during the vertical 

of the control program storing area 51 of the CPU 23. FIG. blanking. The audio data and image data are sent using a 

10 is a flowchart showing the process performed after a card time sharing method to the memory card 16. The above 

is inserted into the camera. After the card is inserted into the described process is equally applicable to both the memory 

camera, step Si determines the type of I/O card and other 45 card and I/O card. 

properties of the card. Once the type is determined, separate FIG. 12 illustrates a system timing diagram when the 
operations are performed depending upon the type of card. image and audio data are read from the memory card (or I/O 
Step S2 indicates the type of card which is inserted such as card) and are decoded or expanded by the camera. In FIG. 
a LAN card, a modem card, a SCSI card, or a flash memory 12, the quantized Huffman table used during encoding and 
card, performed and the optimum construction of the hard- 50 decoding is transferred to the image expanding portion of 
ware operation is established from the effective operational the image data compression/expansion circuit 12. The corn- 
environment in step S3. Next, the cards are initialized by pressed images and audio information are transferred via 
register initialization which corresponds to the particular DMA from the memory card to the corresponding FIFO of 
type of I/O card in step S4. The process then ends. At any the FIFO circuit 13. The CPU 23 then issues an instruction 
time during the process illustrated in FIG. 10, the control 55 to start expansion in order to decode the image and audio 
program is transferred from the I/O card to the memory information. Subsequent image information is read and 
within the camera. After the process illustrated in FIG. 10 is transferred via DMA. With regard to the audio information, 
performed, whenever the camera performs an I/O function, the audio is read one byte per 250 microseconds. Usually, 
the CPU 23 executes the protocol control of the respective the operation of reading out the audio data to the audio FIFO 
I/O card in accordance with the loaded control program so 60 is practiced during the vertical blanking period. In such a 
that the camera can transmit and/or receive image data, manner, the audio data are received independently of the 
audio data, status information, and/or commands. As an image data and transferred to the camera and decoded, 
alternative, it is possible to execute the I/O control program However, the audio and image data are synchronously 
within the card without transferring the control program to presented to a viewer. Further descriptions of the use of 
the camera. 65 audio and video in electronic cameras is disclosed in U.S. 

The memory card such as a flash memory card is con- Pat. No. 5,062,010 and U.S. Pat. No. 5,032,918, both of 

sidered a type of I/O card. For any type of memory card such which are incorporated herein by reference. 
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The encoded JPEG image information is based on a 
Huffman table and a quantizing table. In order to decode 
encoded information, it is necessary to have the same 
information 10 which was used to encode the image. As long 
as the decoder has access to the same tables which were used 
for encoding, there is no need to store and transmit the 
Huffman and quantizing tables with the encoded signals. 
FIG. 13A illustrates the transmitted and stored information 
as containing the Huffman table, quantizing table, and coded 
image data. 

If the Huffman table is available to both the encoder and 
decoder, it is not necessary to include the Huffman table with 
the encoded data. However, as the quantizing information of 
the encoded data changes, it is necessary to include the 
quantizing table with the encoded information, as illustrated 
in FIG. 13B. However, the quantization table takes up 
storage space and a more efficient way of transmitting and 
storing the encoded image data is to have the same quan- 
tizing table at both the encoder and decoder. However, as the 
quantizing values change, it is necessary to have some sort 
of representation as to the degree of quantization. One 
manner of accomplishing this is to transmit a scale factor 
which is multiplied by valueg in the quantization table 
available to both the encoder and decoder in order to 
determine the final quantinution values. FIG. 13C illustrates 
the coded information containing both the scale factor and 
coded image data. FIG. 13C is the minimum amount of 
coded image information which can be transmitted. 

Regarding the encoded audio signals, when the audio is 
encoded using a typical audio compression method, a table 
is used to code the audio data. In order to assure that when 
the encoded audio is expanded or decompressed, a table 
used during the encoding process may be included in a 
packet of audio information, as illustrated in FIG. 14A. 
However, if it is known that the decoder or expansion circuit 
will contain the same table as was used to encode the audio 
information, it is not necessary to transmit the table with the 
encoded data and the encoded audio information packet can 
be constructed as illustrated in FIG. 14B. 

FIG. 15 is a flowchart illustrating the process of receiving 
a command through the I/O card 15 and the manner of 
processing various commands. The illustrated process can 
be performed when commands are. received by the camera 
from any command source. In FIG. 15, after starting, step 
Sll receives a command. The type of command is deter- 
mined by the CPU 23 in step S12. Any type of com mand^ can 
be received and ^processed by th e p^aTBera includin g any 
known command used to operate and controTdigital elec- 
tronic cameras including electronic cameras capable for 
detecting one or a series of still pictures and displaying the 
pictures. 

If the command is to cha nge the amount o f ^nmpresyi nn 
of images, step S13-1 determines ihal me image compres- 
sion coefficient changing command has been received. This 
command can indicate a percent change in the amount of 
data needed to store the image or may directly contain a 
scale factor. A new quantizing table is calculated in step S14 
based on the received image compression coefficient chang- 
ing command. It is necessary to calculate the quantization 
table so that the amount of data necessary to code an image 
is within a predetermined range which is neither too large 
nor too small. The calculated quantized table is then written 
into the image data compression/expansion circuit 12 in step 
S15-1. The process then ends. 

When the received command indicates that a pixel num- 
ber changing command is received such as indicated in step 
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S13-2, processing is performed in the image data 
compression/expansion circuit 12 and/or the digital signal 
processing circuit 11. This can be accomplished in a known 
manner by changing the quantization in accordance with a 

S rate control method. Step S15-2 changes the parameters 
used to operate the circuitry in order to obtain the desired 
number of pixels. 

When an a spect chang ing _c q rr|rn?nd is received as indi- 
cated in step S13-3, an interpolation processing of pixels is 

10 performed so as to obtain the desired aspect ratio by setting 
the appropriate parameters in the digital signal processing 
circuit 11 in step S15-3. 

Other parameters of the camera are changed in similar 
manners. For example, when the received command indi- 

15 cates to change the audio compression coefficient as illus- 
trated in step S13-4, the command to change the amount of 
audio compression is determined and the table used during 
the audio compression process is changed in step S15-4. 
When the received command indicates to change the audio 

20 sampling frequency as illustrated in step S13-5, the audio 
sampling frequency is changed by altering the parameters of 
the analog to digital converter 4 in step S15-5. Similarly, 
when the received command indicates to change the sam- 
pling number of bits for the audio in step S13-6, parameters 

25 are modified so that the audio analog to digital converter 4 
outputs the appropriate number of bits in step SI 5-6. Further 
details regarding the processing performed in response to 
various types of commands used to change the parameters of 
a camera are disclosed in U.S. Pat. No. 5,034,804, which is 

3 q incorporated herein by reference. 

Any. other command used to control^and/QLjane jate^the 
camera can be set rem otely thrnuphJh£-I/Q rardl_S These 
coTrrmaTras mcluae commands to take a sin gle pictu re or a 
series of moving pictures, commands of whether or not to 

35 use the flash, focus parameter changing commands, expo- 
sure changing commands, commands to zoom the camera 
lens, commands to record only images, only audio, or a 
combination of images and audio, etc. These commands 
may be transmitted to the camera through the I/O card by 

40 either of the computers 33 or 35 illustrated in FIG. 3. 
Further, the commands may be transmitted by a dedicated 
handheld device such as an infrared remote, wired remote 
controller, or any other device. Further, any number of 
cameras and/or controllers such as computers may be con- 

45 nected together. Codes may be included in the communica- 
tions between the cameras and controllers such as com- 
mands indicating the camera manufacturer's name, the 
model of the camera, the serial number of the camera, or any 
other identifying information of the camera or the controller. 

50 This will allow a plurality of cameras and controllers to be 
connected through a LAN or other means. 

As the compression rate, pixel numbers, and pixel aspect 
ratio of the image signals can be changed either by the 
camera or remotely through the I/O card 15, the amount of 

55 encoded data representing the images can be controlled so 
that the bandwidth needed for transmission of the images to 
a remotely located monitoring device can properly occur 
without transmission errors. Further, since the compression 
rate, sampling frequency, sampling bit numbers of the audio 

60 data can be changed, the bandwidth can also be controlled 
or restriction thereof met. Additionally, whether or not the 
table data of the audio signals and the Huffman table, 
quantizing table, or scale factor is transmitted along with the 
coded image signals may be remotely set in order to reduce 

65 the amount of information which is needed to be transmitted. 
The invention also allows automatic exposure controlling 
evaluation value data, automatic white balance controlling 
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evaluation data, and automatic focusing evaluation data to changes in the luminance and/or focusing value can be used 
be created and outputted to a remote monitoring device such to indicate movement within an image, thus alerting a 
as a computer, the state of the camera can be judged remote operator that something is changing in the environ- 
automatically and the compression ratio and number of pixel ment which is being photographed or monitored remotely, 
can be changed automatically based on the received image 5 This alarm can be either a warning light type of indicator 
information. and/or an audio warning. The connection between the cam- 

The present invention evaluates various aspects of images era 0/0 card thereof) and the monitoring device allows 

which have been captured by the camera in order to perform images to be both received by the monitored device and 

automatic correction in the processing of the parameters transferred from the monitoring device to the camera, 

used to capture images. The digital signal processing circuit 10 The CPU 23 of the camera 30 evaluates the property of 

11 performs data compression in accordance with, for me V° card 15 connected thereto. Depending upon the 

example, the JPEG standard, or an MPEG standard. In order communication capabilities such as bandwidth of the type of 

to perform these compression procedures, the image is I/O card, the CPU selects operating parameters of the camera 

broken down into components, such as by creating coeffi- m ord er to make the best use of the available I/O capabilities, 

cients in accordance with a known discrete cosine transfer- 15 parameters which can be set based on the capabilities of 

mation (DCT) process in the digital signal processing circuit me I/O card are described in the flowchart of FIG. 15. 

11. In FIG. 16, the DCT coefficients are received and As theJlCLca rd _15_ also is provided with a memory fo r 

processed by the circuits 70, 71, and 72 which are shown in sto ring images and audio, it is not necessary 10 pave 11 a 

FIG. 16. These circuits may be connected between the separate recording medium for the captured images and 

digital signal processing circuit 11 and the CPU 23 in FIG. 2 o aucuo > although of course it is possible to have a separate 

30. Alternatively, the functions performed by these circuits recording medium. Further, by locating the memory within 

may be carried out in the CPU 23. The DCT coefficients are the I/O card, it is not necessary to create special data 

obtained for subregions of the images which are arranged in transferring circuitry between the recording medium and the 

grid-like patterns. Further details of the DCT, quantizing, I/O card as the memory and necessary image and audio 

Huffman coding, the use of a coding table and scale factor 2 5 si g nals and data are stored within the I/O card 15. 

and disclosed in U.S. Pai. No. 5,295,077, which is incorpo- Additionally, as the memojy, f n i^riag -i mas gs. and data 

rated herein by reference. may be located in the I/O card 15, the reliability of the 

In FIG. 16 there is illustrated an exposure evaluation system improves as it is not necessary to have two physically 

value creating circuit 70. This circuit sums up the DC separate cards to perform the I/O operation and storing 

component of the luminance signals Y for each of the areas 30 operation. 

within an image in order to create a value indicating the The programming of a conventional computer to control 

brightness of the captured image and to indicate how the the camera externally can be implemented in a conventional 

exposure is to be automatically adjusted. Also illustrated is manner by one of ordinary skill in the art. Further, it is not 

a white balance evaluation balance creating circuit 71 which required to have the I/O card or the memory card conform 

is used to automatically adjust the white balance of the 35 to the PCMCIA standard but any type of I/O interface or 

images. For example, artificial light has specific color com- memory device such as a hard disk, floppy disk, optical disk, 

ponents which are usually larger than the color components optical card, or any other device may be used to implement 

making up natural sunlight. Accordingly, the various color the described functions. Each of the features of the present 

components of the images needs to be adjusted in order to invention can be incorporated into an electronic filmless 

have the final image appear to have balanced color. In this 40 camera such as the camera described in the specification, the 

circuit, the DC components of the red signal minus the Ricoh DC-1 digital video camera which has both still and 

luminance signal are summed and in a similar manner, the moving image recording modes, or any other known camera 

summation of the DC components of the blue signal minus with an electronic image pick up. Each of the values being 

the luminance signal is performed in order to obtain the processed by the present invention are signals corresponding 

white balance evaluation information. Further, there is a 45 to physical phenomena such as focusing characteristics of an 

focus evaluation value creating circuit which creates a focus image, brightness of an image, color balance, etc. 

evaluation value based on the AC component of the lumi- The present invention can be implemented in a digital 

nance signals summed over the image. The high frequency camera using an electronic processor such as a micropro- 

component of the luminance signals after integrated may be cessor or a digital signal processor programmed according to 

used to obtain the focus evaluation value. The camera may 50 the teachings of the present invention, as will be apparent to 

be focused in accordance with the method disclosed in those skilled in the art. Appropriate software coding can 

commonly ed co-pending U.S. patent application Ser. No. readily be prepared by skilled programmers based on the 

08/522,666, filed Sep. 1, 1995, entitled "A Focus Control- teachings of the present disclosure, as will be apparent to 

ling Method and Apparatus" (attorney docket 557-3543-2), those skilled in the software art. The invention may also be 

which is incorporated herein by reference. 55 15 implemented by the preparation of applications specific 

When the state of the camera and camera parameters are integrated circuits whereby interconnecting an appropriate 

transmitted to a monitoring device which is external to the network of conventional component circuits, as will be 

camera through the I/O card 15, the above-described evalu- readily apparent to those skilled in the art. The invention is 

ation values and signal are outputted as part of the status also the I/O card containing the memory used to store the 

signals from the camera side, as desired. It is possible to 60 control program. 

mo nitor abnormal occurrences _by a remote monitoring Obviously, numerous modifications and variations of the 

evice by monitoring the above-described values and also to present invention are possible in light of the above teach- 

etect variation in the state of the camera including a power ings. It is therefore to be understood that within the scope of 

upply failure or depletion, a stopped operation of the the appended claims, the invention may be practiced other- 

amera whether or not the flash is ready (charged), whether 65 wise than as specifically described herein, 

coding error has occurred, whether there is sufficient light What is claimed as new and is desired to be secured by 

obtain an adequate image, or any other factor. Further, Letters Patent of the United States is: 
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1. A digital image capturing system, comprising 
a digital image capturing device including: 

a lens; 

an electronic image pick-up which receives images 

through the lens; 
a processor; 

a communication interface, connected to the processor, 
which transfers information into and out of the 
digital image capturing device, 

a detachably connected input/output interface includ- 
ing: 

a connector which detachably connects to the com- 
munication interface of the digital image captur- 
ing device; and 

a connector which connects to a processing device 
which is external to the digital image capturing 
device, 

wherein: 

the communication interface of the digital image 
capturing device receives commands for con- 
trolling an operation of the digital image cap- 
turing device from the processing device and 
the processor of the digital image capturing 
device controls the digital image capturing 
device in accordance with the received 
commands, 

the communication interface of the digital image 
capturing device transmits parameters describ- 
ing a state of the digital image capturing device 
to the processing device, and 

the detachably connected input/output interface 
further includes: 

a memory for storing a control program for 
controlling communication between the digital 
image capturing device and the processing 
device. 

2. A system according to claim 1, wherein the commands 
received by the communication interface from the process- 
ing device include at least one of a command for changing 
an image compression rate, a command for changing a 
number of pixels of images, and a command to change an 
aspect ratio of the images. 

3. A system according to claim 1, wherein the digital 
image capturing device further comprises: 

means for encoding images captured by the electronic 

image pick-up; and 
selection means for selecting whether the means for 

encoding images encodes the images to include a 

quantization table or a scale factor used for determining 

a quantization value. 

4. A system according to claim 1, wherein the processor 
of the digital image capturing device creates at least one of 
exposure evaluation information, white balance evaluation 
information, and focus evaluation information which is 
transferred to the processing device through the communi- 
cation interface of the digital image capturing device. 

5. A system according to claim 1 wherein the communi- 
cation interface of the digital image capturing device oper- 
ates using the control program. 

6. A system according to claim 5, wherein the digital 
image capturing device further includes: 

a control program memory; and 

means for transferring the control program from the 
memory of the interface to the control program 
memory of the digital image capturing device. 

7. A system according to claim 1, wherein the digital 
image capturing device further includes: 
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a memory "for storing images captured by the electronic 

image pick-up, 
wherein the communication interface of the digital image 

capturing device further includes means for transfer- 
5 ring images stored in the memory of the digital image 

capturing device to the processing device. 

8. A system according to claim 7, wherein the digital 
image capturing device further includes: 

a display which displays images stored in the memory of 
10 the digital image capturing device. 

9. A system according to claim 8, wherein: 

said display is for displaying the parameters describing 
the state of the digital image capturing device and a 
state of the detachably connected communication inter- 

15 face " 

10. A system according to claim 1, wherein the digital 
image capturing device further includes: 

image coding means for encoding digital representations 
of images captured by the electronic image pick-up. 

11. A system according to claim 10, wherein the digital 
20 image capturing device further includes: 

a microphone for capturing audio signals. 

12. A system according to claim U, wherein the com- 
mands received by the communication interface from the 
processing device include at least one of a command to 

25 change a compression rate of the audio signals, and a 
command to change a number of sampling bits of the audio 
signals. 

13. A system according to claim 11, wherein the digital 
image capturing device further comprises: 

30 means for encoding audio signals captured by the micro- 
phone; and 

selection means for selecting whether the means for 
coding audio signals encodes the audio signals to 
output only encoded audio or both encoded audio and 
35 a table used during a decoding process. 

14. A method for communicating between a digital image 
capturing device and a processing device external to the 
digital image capturing device, comprising the steps of: 

transmitting control commands from the processing 
device to the digital image capturing device; 

receiving the control commands by a detachable commu- 
nication interface connected to the digital image cap- 
turing device; and 
45 changing a state of the digital image capturing device 
using the received control commands, 

said method further comprising the steps of: 

determining a state of the digital image capturing 
device; 

50 transmitting parameters describing the determined state 
of the digital image capturing device through the 
detachable communication interface to the process- 
ing device, 

said method further comprising the steps of: 
55 loading a control program from a memory in the 

detachable communication interface into a 
memory of the digital image capturing device, 
wherein the step of transmitting parameters transmits 
the parameters using the control program in the 
60 memory of the digital image capturing device. 

15. A method according to claim 14, further comprising 
the steps of: 

capturing an image by an electronic image pick-up device 
of the digital image capturing device; and 
65 transmitting the captured image from the digital image 
capturing device through the detachable communica- 
tion interface to the processing device. 
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16. A method according to claim 15, further comprising 
the steps of: 

capturing audio signals by a microphone of the digital 
image capturing device; and 

transmitting the captured audio signals from the digital 5 
image capturing device through the detachable com- 
munication interface to the processing device. 

17. A method of operating a digital image capturing 
device which is for connection to a processing device 
external to the digital image capturing device, comprising 10 
the steps of: 

receiving control commands which were transmitted from 
the processing device by a detachable communication 
interface connected to the digital image capturing 
device; and 

changing a state of the digital image capturing device 

using the received control commands, 
said method further comprising the steps of: 

determining a state of the digital image capturing 20 
device; 

transmitting parameters describing the determined state 
of the digital image capturing device through the 
detachable communication interface to the process- 
ing device, 
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said method further comprising the steps of: 

loading a control program from a memory in the 
detachable communication interface into a 
memory of the digital image capturing device, 
wherein the step of transmitting parameters transmits 
the parameters using the control program in the 
memory of the digital image capturing device. 

18. A method according to claim 17, further comprising 
the steps of: 

capturing an image by an electronic image pick-up device 
of the digital image capturing device; and 

transmitting the captured image from the digital image 
capturing device through the detachable communica- 
tion interface to the processing device. 

19. A method according to claim 17, further comprising 
the steps of: 

capturing audio signals by a microphone of the digital 
image capturing device; and 

transmitting the captured audio signals from the digital 
image capturing device through the detachable com- 
munication interface to the processing device. 

***** 
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